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1.  Summary 

We  describe  an  approach  to  automatic  segmentation  and  derivation  of  body  size  meas¬ 
urements  from  3D  whole  body  scan  data  without  the  aid  of  pre-placed  markers. 

2.  Introduction 

Sytronics,  Incorporated,  is  pleased  to  submit  this  final  report  describing  the  methods  and 
conclusions  for  the  “Proof-of-Concept”  research  performed  under  Navy  SBIR  Topic  N9 8-029, 
“Automatic  Derivation  of  Traditional  Anthropometric  Measurements  From  Whole  Body  Scan 
Data.”  The  US  Navy  opened  up  this  topic  to  investigate  the  possibilities  of  reliably  extracting 
measurement  information  from  whole  body  scan  data  for  the  use  in  tailor  or  garment  fitting. 


The  purpose  of  a  Phase  I  SBIR  is  a  “Proof-of-Concept.”  Our  objective  is  to  demonstrate 
an  innovative,  yet  sound  approach  and  solution  to  the  Topic  problem.  It  is  our  belief  that  the 
methods  developed  and  presented  here  provide  conclusive  evidence  that  accurate  and  repeatable 
clothing  measurements  are  extractable  from  this  type  of  data  without  the  use  of  pre-marked 
landmarks  or  operator  intervention,  either  during  the  scanning  or  measurement  process. 

3.  Methods,  Assumptions,  and  Procedures 

3.1  Data  Collection.  Three-dimensional  (3-D)  surface  scan  data  for  this  research  is  provided 
by  the  Textile  and  Clothing  Technology  Corporation  ([TC]2).  The  [TC]2  scanning  system  is  a 
visible  light  measurement  system  called  Phase  Measuring  Profilometry  (PMP)™.  A  light  source 
is  used  to  project  a  sinusoidal  pattern  onto  the  surface  of  the  object  to  be  scanned.  Differences  in 
surface  topology  cause  deformations  of  the  sinusoidal  pattern  and  are  captured  by  six  CCD  cam¬ 
eras  and  stored  on  a  computer.  The  resulting  contour  image  files  are  processed  and  produce  point 
cloud  files  of  the  scanned  surface,  as  seen  from  each  of  the  CCD  cameras.  The  six  PMP  point 
raw  point  cloud  data  files  are  combined  into  a  single  point  cloud  representing  the  scanned  sur¬ 
face. 
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Figure  1.  Point  Cloud  Data 


3.2  Data  Preprocessing.  There  is  no  preprocessing  of  the  point  cloud  data  as  received  from 
[TC]2.  All  of  the  algorithms  presented  operated  on  the  raw  data  provided  or  the  intermediate 
output  of  another  algorithm. 

3.3  Data  Visualization.  Although  visualization  of  the  data  and  outputs  are  not  specifically 
required  for  this  project,  a  flexible  viewer  capable  of  displaying  multiple  independent  or  depend¬ 
ent  objects  comprising  a  large  number  of  points  or  vectors  was  necessary  to  view  intermediate 
and  final  results.  The  GL  Object  Visualization  Environment  (GLOVE)  was  developed  to  meet 
these  needs. 

GLOVE  is  based  on  OpenGL  and  uses  the  Microsoft  Foundation  Class  (MFC)  Multiple  Docu¬ 
ment  Architecture  (MDI).  GLOVE  can  read  raw  XYZ-point  files  that  are  either  comma  or  space 
delimited,  such  as  the  TC2  point  cloud  data.  In  addition,  GLOVE  uses  its  own  object  file  format 
that  is  optimized  for  flexibility  and  readability.  By  default,  the  GLOVE  object  file  format  is 
ASCII,  but  can  be  binary  for  I/O  performance  considerations. 

3.4  Assumptions.  The  point  cloud  is  free  of  stray  noise  data  (significantly)  off  the  surface  of 
the  subject.  No  marks  could  be  placed  on  the  body  before  the  scanning  procedure. 

3.5  Measurement  Extraction  Approach.  We  have  identified  two  potential  approaches  to 
extracting  measurements  from  scan  data  without  the  aid  of  pre-placed  markers:  templates  and 
segmentation.  The  template-based  approach  involves  the  generation  of  either  a  deformable  3-D 
template  or  several  templates  of  the  body,  from  which  to  match  subject  data.  In  one  case,  the 
deformable  template  is  distorted  to  fit  the  data.  With  an  “atlas”  of  several  templates,  the  data  are 
matched  to  the  closest  fitting  template.  Once  a  tolerable  match  is  achieved,  landmarks  can  be 
encoded  into  the  template(s)  from  which  measurements  can  be  obtained.  In  either  case,  complex 
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neural  or  genetic  algorithms  may  be  required  to  optimally  distort  shape  information  to  select  a 
match.  In  addition,  a  large  number  of  training  data  are  required  to  generate  statistically  accurate 
templates.  Although  this  approach  has  merit,  the  foreseen  need  of  a  large  number  of  data  sets  is 
not  available  within  the  limited  schedule  of  the  SBIR. 

Our  approach  is  to  segment  the  point  cloud  data  into  a  collection  of  cylinders.  Each  cylinder  en¬ 
capsulates  data  for  a  specific  region  of  the  body.  The  desired  measurements  can  be  made  based 
on  a  combination  of  one  or  more  of  these  cylinders. 


Figure  2:  Human  Cylinder  Form 


3.6  Overview  of  the  Technique.  The  technique  we've  developed  involves  the  definition  of  a 
representative  3-D  “stick  figure”  within  the  point  cloud  data.  Each  stick  figure  is  computed  dy¬ 
namically  and  is  unique  to  the  point  cloud  data  in  use.  The  stick  figure  is  comprised  of  a  collec¬ 
tion  of  vectors  within  the  point  cloud  data.  Once  the  stick  figure  is  computed,  the  portions  of  the 
point  cloud  data  related  to  the  specific  stick  figure  vectors  can  be  extracted  and  used  for  addi¬ 
tional  computation.  This  data,  along  with  the  corresponding  vectors  used  for  extraction,  defines 
the  basis  for  the  cylinder(s)  used  in  measurement.  As  described  here,  the  process  is  essentially 
broken  down  into  these  areas,  described  in  turn: 

■  Computing  vectors  to  define  the  stick  figure, 

■  Extraction  of  data  corresponding  to  specific  stick  figure  data,  and 

■  Obtaining  measurements  from  the  extracted  data. 

3.6.1  Computing  Vectors  to  Define  the  Stick  Figure.  A  stick  figure  can  be  created  by  find¬ 
ing  centroids,  then  combining  the  results  (using  linear  regression  or  similar  methods)  into  line 
segments  or  vectors.  This  illustration  demonstrates  centroids  collected  orthogonal  to  the  figure's 
major  axis,  and  shows  the  resulting  line  segment  defined  by  the  centroids.  A  similar  approach 
can  be  taken  with  ellipse  data.  Centroids  can  be  collected  from  multiple  ellipses,  then  combined 
into  line  segments  or  vectors.  The  image  shown  here  illustrates  this  point.  Sequential  ellipse 
centroids  form  a  “path”  through  the  data  set,  representing  the  centroid  of  each  cylinder.  This 
method  provides  the  cylinder  centroids  upon  which  segmentation  decisions  are  based. 
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Figure  3.  Centroids 

We  must  compute  ellipses  from  point  data  if  we  want  to  use  ellipse  centroids.  A  method  called 
“Direct  Least  Squares  Fitting  of  Ellipses”  [**]  (DLSFE)  guarantees  the  computation  of  an  ellipse 
when  provided  with  point  data  (other  methods  may  produce  non-ellipsoid  results  for  “interest¬ 
ing”  data;  see  reference  for  details).  The  figure  shown  here  demonstrates  the  ellipses  produced 
by  the  DLSFE  algorithm  for: 

■  Highly  elliptical  data  (A), 

■  Noisy  highly  elliptical  data  (B), 

■  Only  a  few  points  of  elliptical  data  (C), 

■  Results  of  multiple  groups  of  data  (D),  and 

■  Results  when  a  significant  outlier  is  present  (E). 

Note  that  illustration  (D)  and  (E)  do  not  portray  optimal  results  for  this  application,  but  these  ef¬ 
fects  will  not  generally  cause  undue  stress  to  the  application  at  hand. 


Figure  4.  Ellipses  Produced  by  the  DLSFE  Algorithm 
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The  DLSFE  algorithm  does  require  a  “reasonable  number”  of  points  (in  the  neighborhood  or  10 
to  20)  for  finding  a  good  ellipse  fit.  Our  implementation  uses  three  user-adjustable  mechanisms 
to  guarantee  a  sufficient  number  of  data  points  are  available  for  fitting  ellipses.  Data  are  proc¬ 
essed  in  “slices”  (all  data  with  a  specified  Z-coordinate)  orthogonal  to  the  working  axis'  col¬ 
lected  an  entire  slice  at  a  time.  The  user  may  specify  the  minimum  number  of  data  points  that 
must  be  present  for  ellipse  fitting  (default  value  is  ten  data  points),  the  minimum  number  of  data 
slices  to  include  (default  is  one  level  of  data),  and  the  minimum  total  height  of  the  data  column 
collected  (the  default  is  zero  units  of  height,  the  difference  between  the  minimum  and  maximum 
Z-coordinates  for  the  data  included).  Consecutive  slices  of  data  are  collected  until  the  criteria 
above  are  met.  The  resulting  data  are  “collapsed”  (that  is,  the  Z-component  is  ignored)  and  an 
ellipse  is  fit  to  the  collected  data.  The  accompanying  figure  illustrates  this  procedure. 


Figure  5.  Data  Points  of  an  Ellipse  Fit 

Collecting  this  centroid  data  can  be  described  as  “climbing”  the  data's  working  axis;  data  from 
several  levels  is  “collapsed”  as  discussed  above,  an  ellipse  is  fit  to  the  collapsed  data,  ellipse  pa¬ 
rameters  are  saved  (as  if  belonging  to  a  specific  level  of  Z),  and  the  procedure  is  executed  from 
the  next  level  of  the  working  axis.  The  process  continues  until  all  data  has  been  processed  and 
centroids  have  been  found.  The  collection  of  these  centroids  is  monotonically  increasing  in  the 
direction  of  the  working  axis. 


1  Internally,  the  working  axis  is  always  the  Z-axis.  This  is  because  the  data  may  be  processed  orthogonal  to  the  X-, 
Y-,  or  Z-axis,  and  the  application  automatically  rotates  the  data  and  re-labels  each  axes  such  that  the  algorithm  is 
always  processing  along  the  Z-axis. 
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Figure  6.  Example  of  Centroid  “Climbing” 

Once  all  centroids  have  been  computed,  a  smoothing  filter  is  applied  to  dampen  the  effects  of 
outliers  and  rough  edges.  “Very  small”  vectors  (whose  sizes  depend  on  user  option,  defaulting 
to  15  units  in  the  direction  of  the  working  axis)  are  created  from  the  centroid  data.  These  small 
vectors  are  merged  into  larger  vectors.  We  use  a  simple  vector-merging  algorithm  that  merely 
adds  two  adjacent  vectors  if  the  angle  between  them  does  not  exceed  some  deadband  degree,  a 
user-definable  number,  defaulting  to  20  degrees.  These  larger  vectors  define  the  stick  figure  cor¬ 
responding  to  the  original  point  cloud  data.  Illustrations  included  here  clarify  these  points. 


Figure  7.  Generating  Vectors  from  the  Centroid  Data 
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The  second  method  uses  a  robust  linear  regression  technique  that  fits  a  line  to  the  centroids  by 
minimizing  absolute  deviation2.  To  begin,  small  vectors  are  approximated  for  the  centroids. 
Again  a  deadband  threshold  is  used,  but  this  method  considers  the  angular  difference  in  slope 
between  two  adjacent  vectors  to  determine  if  the  vectors  should  be  merged.  The  resulting  output 
is  a  stick  figure  that  approximates  a  best  path  through  the  centroids. 

3.6.2  Extraction  of  Data  Corresponding  to  Specific  Stick  Figure  Data.  Stick  figure  infor¬ 
mation  provides  the  means  required  for  cloud  data  segmentation.  Recognizing  the  cloud  data 
corresponding  to  the  line  segment  endpoints  permits  us  to  extract  the  relevant  portion  of  data  into 
a  separate  file  for  additional  processing.  The  simplest  way  to  automate  such  extraction  is  to  de¬ 
velop  a  simple  set  of  heuristics  allowing  definition  of  the  sick  figure  line  segments  to  be  included 
in  the  extraction.  We  have  developed  several  simple  heuristics  as  a  demonstration  and  proof-of- 
concept. 

The  heuristics  “language”  is  very  simple,  consisting  of  only  four  major  commands  (start,  stop, 
move,  and  model)  and  a  few  sub-commands.  A  “program”  written  in  this  heuristic  language  is 
typically  very  short  (less  than  25  characters  long).  The  sole  purpose  of  this  language  is  to  de¬ 
scribe  the  nature  of  the  line  segments  (and  thus  the  corresponding  point  cloud  data)  to  be  in¬ 
cluded  for  extraction. 

Stick  figure  vectors  are  traversed  sequentially,  beginning  with  the  first  vector  in  the  stick  figure. 
The  start  and  stop  command  begin  and  end  the  inclusion  of  vectors,  respectively.  Move  and 
model  (and  their  subcommands)  are  used  to  conditionally  traverse  the  vector  list,  including  vec¬ 
tors  as  they  go. 

3.6.3  Obtaining  Measurements  from  the  Extracted  Data.  Measurements  are  obtained  from 
the  original  point  cloud  using  the  stick  figure  to  traverse  and  identify  body  segments.  The  point 
cloud  is  segmented  into  many  well-defined  pieces  that  enable  an  almost  trivial  measurement  ex¬ 
traction.  For  example,  consider  the  seated,  buttock-knee  length  measurement:  the  stick  figure  is 
used  to  segment  the  data  until  only  the  right  buttock-thigh-knee  data  remain.  From  this  small 
segment,  the  buttock-knee  length  becomes  a  simple  horizontal  measure  of  the  extents  of  the  re¬ 
maining  point  cloud  data  at  the  centroid  of  the  thigh. 

Similarly,  each  measurement  can  be  defined  by  a  method  of  measurement  (length,  orientation, 
circumference,  point-to-point)  and  the  segment  that  contains  the  data  required  to  support  the 
measurement. 


2  Press,  W.,  et  al.,  Numerical  Recipes  in  C:  The  Art  of  Scientific  Computing,  2nd  Edition,  pp703-705 
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3.7  Measurement  Definitions.  Traditional  anthropometric  measurements  are  based  mostly 
on  sub-surface  landmarks3.  Obviously  sub-surface  information  is  unavailable  to  the  surface 
scanning  modality.  Consequently,  measurements  must  be  defined  in  terms  of  reliable  (and  ob¬ 
tainable)  body  surface  features. 

3.7.1  Seated  Measurement  Descriptions. 

■  Buttock  Knee  Length:  From  the  front  of  the  knee  to  the  buttock,  along  the  thigh 
centroid. 

■  Abdominal  Extension  Depth,  Sitting:  Horizontal  length,  from  the  anterior  abdo¬ 
men  through  to  the  back. 

■  Knee  Height,  Sitting:  The  vertical  distance  from  the  footrest  surface  to  the  cen¬ 
troid  top  penetration  point  through  the  knee  surface. 

■  Hip  Breath,  Sitting:  The  most  lateral  points  on  the  hips  or  thighs,  whichever  is 
broader. 

■  Popliteal  Height:  The  vertical  distance  from  the  footrest  surface  to  the  bottom 
surface  of  the  thigh  at  the  knee  intersection. 

■  Acromion  Height:  The  vertical  distance  from  the  sitting  surface  to  the  vertical 
projection  point  of  the  arm-torso  segmentation  plane. 

■  Sitting  Height:  The  vertical  distance  from  the  sitting  surface  to  the  top  of  the 
head. 

■  Thigh  Clearance:  The  vertical  distance  from  the  sitting  surface  to  the  highest 
point  of  the  thigh,  before  the  trunk  intersection. 

■  Shoulder  Circumference:  The  torso  surface  circumference  at  the  arm  centroid 
height. 


3  Clauser,  Tebbetts,  Bradtmiller,  McConville,  and  Gordon  (1988)  Measurer’s  Handbook;  US  Army  Anthropometric 
Survey,  Natick  Technical  Report  TR-88/043;  Name  Anthropometric  Source  book  1024;  DoD-HDBK-743 
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3.7.2  Measurement  -  Segment  Summary. 


TABLE  1 

Segment  Requirements  for  Measurements 
*  -  Centroid  endpoint  required 


LEGS 

RIGHT  LEG 

RIGHT  ARM 

TORSO  j 

Buttock  Knee  Length 

Abdominal  Extension  Depth,  Sitting 

Knee  Height,  Sitting 

✓ 

Hip  Breadth,  Sitting 

Popliteal  Height 

Acromion  Height 

Sitting  Height 

Thigh  Clearance 

Shoulder  Circumference 

* 

3.7.3  Standing  Measurement  Descriptions. 

■  Sleeve  Length:  The  top  surface  length  of  the  right  arm  from  the  vertical  projec¬ 
tion  of  the  arm  centroid  endpoint  to  the  tip  of  the  finger  surface. 

■  Crotch  Height:  The  vertical  distance  from  the  standing  surface  to  the  lowest  thigh 
intersection  point  at  the  crotch. 

■  Back  Waist  Length:  The  vertical  distance  from  the  height  of  the  natural  minimum 
waist  indentation  to  the  cervicale. 

■  Chest  Circumference:  The  horizontal  surface  circumference  at  the  lower  surface 
penetration  of  the  arm  centroid  upper-most  end  point. 

■  Shoulder  Circumference:  The  torso  surface  circumference  at  the  arm  centroid 
height. 

■  Waist  Circumference:  The  horizontal  surface  circumference  at  the  natural  mini¬ 
mum  waist  indentation. 

■  Buttock  Circumference:  The  horizontal  surface  circumference  at  the  height  of  the 
maximum  protrusion  of  the  right  buttock. 

■  Neck  Circumference:  The  minimum  surface  circumference  around  the  neck,  be¬ 
low  the  chin. 
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3.7.4  Measurement  -  Segment  Summary . 


TABLE  2 

Segment  Requirements  for  Standing  Measurements 


LEGS 

RIGHT  ARM 

TORSO 

Sleeve  Length 

V 

Crotch  Height 

V 

Back  Waist  Length 

V 

Chest  Circumference 

* 

< 

Shoulder  Circumference 

* 

V 

Waist  Circumference 

V 

Buttock  Circumference 

V 

Neck  Circumference 

v  ! 

3.8  Results  and  Discussions.  The  following  section  describes  the  specific  results  of  the 
methods  and  approach  described  when  applied  to  the  test  data. 

3.9  Obtaining  Ellipse  Centroids.  With  a  multi-pass  approach,  the  data  are  first  “rough-fit” 
with  the  estimation  of  ellipses  along  the  X-,  Y-,  and  Z-axis.  Point  cloud  data  are  collapsed  by 
intervals  along  the  axis  of  interest.  The  interval  size  is  controlled  by  several  parameters: 

■  The  minimum  height  in  millimeters  of  the  interval, 

■  The  minimum  number  of  points  to  collect  for  ellipse  estimation,  and 

■  The  minimum  different  levels  (in  Z)  to  collapse. 

Interval  data  are  collapsed  to  a  single  plane  and  the  resulting  bi-coordinate  points  are  used  to  es¬ 
timate  an  ellipse,  noting  its  major  axis,  minor  axis,  and  centroid.  This  process  is  repeated  along 
the  length  of  the  axis,  resulting  in  a  collection  of  ellipse  centroid  points.  The  centroids  are  fil¬ 
tered  with  a  smoothing  kernel  to  (clean)  the  data. 
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Figure  8.  Ellipse  Centroids  Along  the  Z-Axis  Figure  9.  Smoothed  Centroids 


3.10  Centroid  Vector  Construction.  Next,  the  connection  of  adjacent  ellipse  centroids  form 
directional  vectors  that  represent  moving  cylinder  centroids  (describing)  the  interval  cylinders 
estimated  from  the  point  cloud  data.  To  build  these  vectors,  initial  vectors  are  sequentially  con¬ 
structed  from  adjacent  points,  until  the  minimum  vector  length  is  obtained  (15  mm).  The  nth 
vector  is  added  to  the  n-1  vector  if  its  direction  is  within  a  selected  number  of  degrees,  called  the 
deadband  limit  (default  =  20 ?).  If  the  vector-to-vector  deadband  is  greater  that  the  deadband 
limit,  the  construction  of  the  current  vector  stops,  and  a  new  one  starts.  This  process  is  repeated 
until  all  centroid  data  points  have  been  assimilated  into  vectors.  The  resulting  representation  is 
similar  to  a  stick  figure  of  the  ellipse  centroids  through  the  human  body. 
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Figure  10.  Centroid  Vector  Results 


3.11  Segmentation.  The  centroid  vectors  (stick  figure)  is  used  to  segment  the  data  into  the  re¬ 
quired  sub-segments  for  each  measurement 
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3.12  Measurement  Extraction.  As  described  earlier,  for  the  buttock-knee  length,  the  data  to 
support  the  measurement  is  the  right  buttock-thigh-knee  segment.  Once  the  segment  has  been 
successfully  obtained,  as  below,  the  measurements  are  obtained  directly  from  the  point  cloud. 


Figure  11.  Data  Segment  to  Support  Buttock-Knee  Length  Measurement 


In  this  case  the  extracted  measure  was  repeatable  within  four  millimeters  (4mm)  of  the  manual 
measurement. 

4.  CONCLUSIONS 

From  the  investigations  performed  and  the  concepts  developed,  it  is  our  conclusion  that 
repeatable  body  size  measures  can  be  automatically  extracted  from  this  type  of  data. 

5.  RECOMMENDATIONS 

There  are  several  areas  that  warrant  further  research  that  simply  was  not  possible  given 
the  time  and  resource  constraints  of  a  short  six  month  SBIR. 

■  Complete  automation  of  the  segmentation  process. 

■  Definition  of  all  measurements  with  respect  to  how  each  measurement  must  be 
taken  and  the  minimum  data  required. 

■  Complete  automation  of  the  measurement  process. 

■  Although  we  achieved  acceptable  results  as  compared  to  sample  manual  meas¬ 
urements,  a  validation  study  needs  to  be  carefully  performed. 

■  An  important  discovery  was  observed  during  this  investigation.  Using  the  cen¬ 
troid  technique  described,  different  bodies  exhibit  similar  “signatures”  when  the 
centroid  vectors  are  created.  Further  investigation  of  this  phenomenon  could  lead 
to  a  signature  analysis  approach  that  would  be  very  robust  in  identifying  physical 
body  features,  leading  to  segmentation. 
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